A Vision-based 3D Hand Interaction for Marker-based AR

The hand interaction between a virtual object and human on Augmented Reality is a major issue to manipulate a rendered object in a convenient way. Conventional 2D image-based recognition and interaction technique in AR has a limitation to perform a natural interaction between the user and the virtual object. In this paper, we present a natural 3D hand interaction with the augmented object by the use of stereo-vision technique. The proposed 3D hand interaction technique can obtain 3D hand position and finger direction while hand is approaching to the virtual object. 3D hand interaction can manipulate the virtual object in a feasible fashion. In addition, it can provide various interactions by detecting the collision between the 3D hand and the virtual 3D object on AR.